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UPDATING  THE  KALMAN  FILTER  IN  TERMS  OF  CORRELATION 
COEFFICIENTS  AND  STANDARD  DEVIATIONS 


INTRODUCTION 

The  problem  of  estimating  a set  of  parameters  or  variables  from  a set  of  measurements 
has  long  been  a problem  of  interest.  Kalman  in  the  early  sixties  provided  a simple  recursive 
estimation  procedure  by  introducing  the  concept  of  state  and  state  transition.  This  proce- 
dure in  some  instances  provided  simpler  implementation  than  batching  techniques.  Since 
Kalman’s  work  a number  of  numerical  procedures  have  been  developed.  An  excellent 
account  of  these  procedures  as  well  as  historical  notes  can  be  found  in  Bierman’s  book  [1] . 
Two  basic  techniques  described  in  Ref.  1 are  the  SRIF  filter  (square-root  information  filter) 
and  the  UDU  filter.  (Actually  UDU  should  be  written  UDU' , where  D is  a diagonal  matrix, 
U is  an  upper  triangular  matrix,  and  U'  is  the  transpose.)  In  both  cases  the  data  are  pre- 
whitened using  Cholesky  factorization.  The  SRIF  filter  is  then  based  on  the  Householder 
transform.  The  UDU  filter  is  based  on  a Cholesky  factorization  of  the  smoothed  covariance 
update  using  one  measurement  at  a time  and  the  modified  Gram-Schmidt  for  updating  the 
predicted  covariances.  These  numerical  techniques  are  claimed  to  have  better  numerical  sta- 
bility than  use  of  the  Kalman  filter  equations  directly  and  may  be  more  amenable  to  hard- 
ware implementation. 

In  this  report  another  factorization  is  considered  for  updating  the  Kalman  filter.  The 
factors  representing  the  correlation  coefficients  and  standard  deviations  are  updated  in  the 
Kalman  filter  rather  than  the  factors  themselves.  Before  these  results  are  obtained  a method 
of  updating  the  Kalman  filter  using  only  matrix  multiplications  and  additions  is  first 
described. 


ONE-BY-ONE  UPDATING  OF  THE  KALMAN  FILTER 

The  Kalman  filter  is  obtained  from  modeling  the  process  as  state  equations,  defining  a 
measurement  procedure,  and  best  estimating  the  states  of  the  systems.  The  state  equation 
and  measurement  process  are  defined  as 

X(k)  = <h(fe)X(fe  - 1)  + \'{k)W(k) 

and 

Xm(k)  = H(k)X(k)+  V(fe), 

where  it  is  desired  to  best  estimate  the  n-by-1  state  vector  X(k).  The  remaining  quantities 
are  an  n-by-n  state  transition  matrix  <l>(fe),  an  n-by-p  matrix  P(fe).  an  n-by-m  measurement 
matrix  H(k),  an  m-by-1  measurement  vector  Xm  ( k ),  and  W{k)  and  V’(fc),  which  are  Gaussian 
noises  with  the  following  properties: 

Manuscript  submitted  March  17,  1978. 

1 


CANTRELL  AND  TRUNK 


E[W(k)]  = 0, 
E[W(k)W'{j)]  = S(k)  bjk, 
£[V(fc)l  =0, 
E[V(k)V{j )]  =Q(k)b]k, 


and 


E[W(k)V(j)]  =0, 

where  bjh  is  1 when  j = k and  is  0 otherwise.  The  covariance  matrices  S(k)  and  Q(k ) are  of 
dimension  p by  p and  m by  m respectively. 

The  best  estimate  of  X(fe),  denoted  by  X (It)  in  the  standard  Kalman-filter  format,  is 

X(fc)  = X(k)  + K(k)[Xm(k)  -//(fe)X(fe)], 

where  K(k)  is  the  filter  gain,  given  by 

K(k)  = P(k)H'(k)Q~Hk), 

in  which  P(/c)  is  the  smoothed  covariance  matrix,  given  by 

P(k ) is  the  predicted  covariance  matrix,  and 

P(k  + 1)  = <l>(fe  + l)?(fe)(l>'(fe  + 1)  + F(fc  + 1 )S(k  + l)r'(fc  + 1). 

The  prediction  is 

X(fe  + l)  = <l>(fe  + l)^(fe)- 

The  filter  operates  in  a predict  and  correct  fashion. 

The  Kalman  filter  can  be  written  in  a slightly  different  form  by  prewhitening  the 
measurement  noise.  This  is  a standard  practice  which  can  be  achieved  using  Cholesky  fac- 
torization as  described  in  Ref.  1.  The  covariance  Q(k)  of  the  noise  V(k ) is  factored  into  the 
form  of 


Q(k)  = LEV 


(la) 


or 


Q~l(k)  = (L,)_1£”1L~1 , 


(lb) 
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where  I.  is  a lower  triangular  matrix  with  1 ’s  on  the  diagonal  and  £ is  a diagonal  matrix  with 
diagonal  elements  The  algorithm  for  obtaining  L and  F is 

~ J ~ 1’  n ~ 

eJ  = q])' 

^kj  = qkjlej>  k =j  + 1,  ....  n, 

and 

<fjk  = qik  - C ijhjejy  k=j  + 1,  n and  / = /e, n. 

With  use  of  equations  (la)  and  (lb)  the  Kalman  filter  can  be  rewritten  as 


X(k)  = X(k ) + K(k)[Zm(k)  - H(k)X(k)],  (2) 

K(k)  = P(k)W(k)E-'(k),  (3) 

p-1(k)  = P~1(k)  + H’WE'1  (k)  H(k),  (4) 

p(k  + 1)  = <i>(fc  + i)P(fe)<i>'(fe  + 1)  + r(fc  + 1 )S(/c  + i)r'(fe  + 1),  (5) 

and 

X(fc  + l)  = <l>(fc  + l)X(fc),  (6) 


where 


Zm(fe)  = £-1Xm(fe) 


and 


H(k)  = L-'H(k). 

Equations  (2),  (3),  (5),  and  (6)  are  easily  updated  by  matrix  multiplications  and  additions. 

A means  of  updating  equation  (4)  which  does  not  involve  a matrix  inverse  will  now  be 
described . 

The  matrix  identity  used  in  converting  forms  of  the  Kalman  filter  [2]  is 

(A-1  + B'C-'B)-1  = A - AB'(BAB'  + C)-1BA , (7) 

where  A and  C represent  covariances.  For  the  special  case  in  which  BAB’  + C is  a scaler, 
equation  (7)  becomes 


(A-1  +B'C"1B)-1  = A - 


AB'BA 
(C  + BAB')  ‘ 


(8) 
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This  result  will  be  used  subsequently. 

The  smoothed  covariance  update,  equation  (4),  is  rewritten  as 

p-l=p-l+  K'fT1  K,  (9) 

where  the  feth-sample  notation  has  been  dropped  for  notational  convenience.  The  pre- 
whitened measurement  matrix  is  defined  as 


H = 


«1 

J<2 


«/ 


(10) 


where  H ( represents  the  ith  row.  Equation  (9)  can  then  be  rewritten  as 


P- 1 = P~'  +[«;  «2  - Hml 


1 1 

~ 

- 0 ...  0 

el 

nl 

1 

H, 

0 - ...  0 

2 

e2 

1 

0 0 ...  — 

Hm 

em_ 

(11) 


Equation  (11)  can  then  be  rewritten  as 

p-1  = D'l  1 1 ' 1 


(12) 


Equation  (12)  can  be  placed  in  recursive  form  by 


Pf'  =Pf\  + K|  ~ Kj,  i = 1, ....  m, 


(13) 


where  Pg1  = P-1  and  P^1  = P_1 . The  matrix  identity  mentioned  previously  in  equation  (8) 
is  applied  to  equation  (13),  yielding 


~ ~ Pi-i »!  Kfi-i 

Pi  = pi- 1 - ~ , i = 1,  •••.  m,  (14) 

«,  + *,p,-_j  «; 

'v  f 

where  e,  + H , P, _ j H , is  a scaler,  because  the  K,  as  defined  in  (10)  are  row  vectors.  Conse- 
quently equation  (14)  shows  that  no  matrix  inverses  need  be  found  to  update  the  smoothed 
covariance.  Equation  (14)  suggests  the  title  of  this  section:  One-by-One  Updating  of  the 
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Kalman  Filter.  Each  measurement  variance,  taken  one  at  a time,  is  prewhitened  and  used  to 
modify  the  smoothed  covariance.  A means  of  updating  the  filter  in  terms  of  correlation 
coefficients  and  s+"r,dard  deviations  is  considered  next. 


UPDATING  OF  THE  KALMAN  FILTER  BY  UPDATING 
THE  CORRELATION  COEFFICIENTS  AND 
STANDARD  DEVIATIONS 

A covariance  matrix  written  in  terms  of  correlation  coefficients  and  standard  devia- 
tions is 

P = DUD,  (15) 

where  the  elements  of  U are  u,-y  = Pijl\/Pii\fPjj  (i  = 1, ...,  n and  j = 1, ... , n)  and  the  ele- 
ments of  D are  dj  = \/pn>  with  the  matrix  D being  a diagonal  matrix  with  diagonal  elements 
dj  which  represent  the  standard  deviations.  The  diagonal  elements  of  U are  l’s  and  the  off- 
diagonal  elements  are  correlation  coefficients  with  values  between  - 1 and  1.  The  one-by- 
one  updating  of  the  Kalman  filter  is  modified  to  reflect  the  factorization  (14). 

The  Kalman-filter  equations  (2)  through  (6)  will  now  be  reexamined,  with  the  fcth  • 
sample  notation  being  eliminated  for  notational  convenience.  Equations  (2)  and  (6)  remain 
the  same,  since  they  do  not  involve  covariances.  These  equations  are 

X=X  + K{Zm  - MX] 

and 

X = <PX. 

The  filter  gain  (equation  (3))  is  written  as 

K = P K'E-1, 

where  each  element  of  the  gain  matrix  K is 


m. 


(16) 


fe/y  = )/<7>  i * 1 , •••,  n and  j = 1, .... 

«=1 

Using  the  factorization  in  equations  (15)  and  (16)  yields  the  gains 

ku-  L <“<«> 

e=i  1 

The  prediction  covariance  update  in  equation  (5)  is  next  examined  for  the  case  of  zero 
process  noise.  The  equation  is 

P=  <t>P<t>'. 
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The  factorization  described  in  equation  (15)  is  used  in  yielding 

DUD  = <t>D  UD  <t>'.  (17) 

Since  D = D ' , equation  (17)  can  be  rewritten  as 

DUD  = D[(D~1<t>D)U(D~1<t>D)']D.  (18) 

The  bracketed  term  of  equation  (18)  is  factored  in  the  form  of  (15),  yielding 

(D-'^UiD-'QW^RUR.  (19) 

The  forms  (18)  and  (19)  then  yield 

D = DR, 

which  is  the  simple  product  of  two  diagonal  matrices. 

The  last  equation  to  consider  is  the  smoothed  covariance,  which  relies  on  the  one-by- 
one  update  previously  described.  The  equation  is 


Pi  = Pi-1 


Ki «; «,?/-! 


«.• + KfPf-i  *; 

for  i - 1, ...,  m and  Pq  = P.  By  use  of  the  factorization  (15),  equation  (20)  becomes 

ft  (n  Ui-iSi-\*'i*iPi-A-i\  - 

DiUiDi=Di.1  U M ^ D(_  1, 

\ ei*^iDi.1Ui.1Di.1x;) 

where  Uq  - U,  Dq  = D,  Um  = U,  and  Dm  - D.  The  vector  Vrl_j  is  defined  as 

Equation  (21)  can  then  be  written  as 

Equation  (22)  is  factored  into  the  correlation  coefficient  form,  where 

U,_1  - V’/V,.  = RUtR. 

Therefore 


(20) 


(21) 


(22) 


Dj  Di.1R, 

which  is  the  product  of  two  diagonal  matrices.  This  completes  the  development. 
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The  role  the  DUD  factorization,  in  terms  of  standard  deviations  and  correlation  coef- 
ficients, plays  in  the  Kalman  filter  is  that  of  the  scale  factors,  and  this  factorization  is 
numerically  different  than  a straightforward  implementation.  This  may  be  an  advantage  in 
some  problems  in  which  the  range  of  standard  deviations  are  known  and  fixed-point  hard- 
ware could  probably  be  used  to  an  advantage.  It  should  be  noted  that  in  the  computations 
the  values  of  the  elements  of  U are  usually  near  1 and  the  values  of  the  elements  of  D 
usually  change  only  slightly  from  the  values  of  the  elements  of  the  previous  D.  This  indi- 
cates that  for  some  problems  good  numerical  accuracy  may  be  achieved. 

The  updating  of  the  Kalman  filter  in  terms  of  correlation  coefficients  and  standard 
deviations  is  similar  in  many  respects  to  Carlson’s  CD  17-filter  update  found  in  Ref.  1.  Both 
rely  on  the  same  form  of  the  Kalman  filter  in  the  one-by-one  update  form  as  previously 
presented.  Both  filters  update  factors  of  the  covariances,  and  both  require  a refactorization 
of  a portion  of  covariance  equations  to  obtain  the  desired  form.  They  are  different  in  that 
the  factorization  is  different. 


SUMMARY 

The  Kalman  filter  was  briefly  reviewed,  and  a one-by-one  covariance  update  technique 
was  shown  to  operate  such  that  the  entire  Kalman  filter  can  be  updated  with  only  matrix 
multiplications  and  additions,  given  that  the  noise  is  prewhitened.  The  one-by-one  update 
operates  on  one  measurement  at  a time  in  a simple  fashion,  and  after  all  measurements  are 
used,  the  Kalman  filter  is  updated. 

The  covariances  are  factored  in  terms  of  correlation  coefficients  and  standard  devia- 
tions, and  the  Kalman  filter  is  updated  in  terms  of  these  factors.  The  technique  is  similar  in 
principle  to  Carlson’s  technique  but  with  a different  factorization. 
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